Skip to content

Optimize integration test execution to reduce infrastructure load#3

Closed
anujc25 wants to merge 1 commit into
mainfrom
anujc/it-test-validation
Closed

Optimize integration test execution to reduce infrastructure load#3
anujc25 wants to merge 1 commit into
mainfrom
anujc/it-test-validation

Conversation

@anujc25
Copy link
Copy Markdown
Owner

@anujc25 anujc25 commented Jan 8, 2026

Thank you for contributing to the CF CLI! Please read the following:

  • Please make sure you have implemented changes in line with the contributing guidelines
  • We're not allowed to accept any PRs without a signed CLA, no matter how small.
    If your contribution falls under a company CLA but your membership is not public, expect delays while we confirm.
  • All new code requires tests to protect against regressions.
  • Contributions must be made against the appropriate branch. See the contributing guidelines
  • Contributions must conform to our style guide. Please reach out to us if you have questions.

Note: Please create separate PR for every branch (main, v8 and v7) as needed.

Description of the Change

This PR optimizes the integration test execution in CI to reduce infrastructure load and improve test reliability.

The main change splits the integration-tests-full-ci Makefile target into 3 sequential batches instead of running all 6 test suites together with high parallelism. Additionally, the number of parallel nodes is reduced from 12 to 4 in the GitHub Actions workflow.

Test suites are now grouped logically into batches that run sequentially with controlled parallelism to prevent infrastructure overload while maintaining reasonable test execution time.

Why Is This PR Valuable?

This change addresses infrastructure load issues that cause test failures due to resource contention. By reducing concurrent load by ~67% (from 12 parallel nodes to 4) and spreading test execution over time through batching, the tests become significantly more stable and reliable on resource-constrained infrastructure.

Users running integration tests in CI environments with limited resources will benefit from more consistent test results and fewer infrastructure-related failures.

Applicable Issues

List any applicable GitHub Issues here

How Urgent Is The Change?

This change improves the reliability of integration tests in CI but is not time-sensitive.

Other Relevant Parties

This affects anyone running the integration-tests-full-ci Makefile target, particularly in CI/CD pipelines.

@anujc25 anujc25 closed this Jan 8, 2026
anujc25 pushed a commit that referenced this pull request Mar 18, 2026
There are more times that we can tap into providing support for.
For now, set up the following types with overridable completion handler
functions:
- Space, Org, AppName
- Binding Name (this more for further experimentation)

ai-assisted=no
TNZ-87450
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant